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ABSTRACT 

Current science assessments in use in the states were 
studied, and the extent to which these assessments meet the goals of 
reform of science education specified by the Anerican Association for 
the Advancement of Science (AAAS) was investigated. These goals were 
identified by the AAAS in "Project 2061: Science for All Americans?" 
Data were derived from surveys conducted by the Education Commission 
of the States (1987) and the U.S. Office of Technology Assessment 
(1987) . Information was further gathered through telephone calls and 
a review of the instruments and supporting documents from the states. 
Commercial teyts in use, particularly in middle schools, were 
examined. It was determined that state science assessments are not a 
driving force in directing the curriculum or instructional practice 
toward the goals of science education reform, state assessments 
varied so widely that their effects on a national science direction 
were questionable. The content of the assessments was generally not 
consistent with the AAAS reform goals, and the process aspects of the 
standardized tests were weak to non-existen An appendix lists the 
states using standardized tests for science assessment ai»d summarizes 
the information in a chart. (SLD) 
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Backgroxind 

Many parts incerlinked in the educational system are current targets for 
study and iiDorovement : national and state policies (regarding such issues as 
funding, standards, and organization of educational institutioiis) , curriculum 
(guidelines, organization, development) teachers (including training, 
credentialing, and retention) , students (contextualized learning, differential 
impacts), parents (motivation, out-of-school learning). In this paper we 
focus on a Dart that often cuts across and often is attributed as having great 
leverage on many of the other parts in this complex system: assessment. 

We use examination of one subject matter area- -science- -and of 
assessment programs at the state level as a lens to examine how assessment and 
curricular goals do or do not work together to support educational 
improvement. This paper reports a conceptual analysis of the matches and 
mismatches between current assessment instruments and desired educational 
goals; the actual implementation of assessment policies, instruments, and 
.practices is not addressed in this study. 

Science Reform and Assessment 

Improvement in science education has been linked to the needs for 
national economic competitiveness, individual functionality in an increasingly 
technological society, and avoidance of a permanent underclass (e.g., NSB, 
1983) Most proposals for science reform have included calls for improved 
assessment (e.g., AAAS, 1989, p. 166; CCSSO, 1989; OERI, 1988). However, such 
calls for educational improvement reflect several different models of the role 
assessments should play in the educational system: as accountability 
mechanisms to protect the public interest, as evaluation tools to inform 
administrative decisions about programs and personnel, as systems directly 
involved in informing classroom instruction and modelling learning outcomes, 
or perhaps some mixture of these motivations (cf. ETS, 1990; Ewell, 1987; 
Nickerson, 1989). Accountability mechanisms include high school basic skills 
exams required for graduation; program evaluation tools support comparison of 
district, building, teacher, or class performances to other units or over 
time; instructional monitoring systems are intended to provide diagnostic and 
prescriptive information at the classroom level. 

It is interesting and important to note that regardless of the role they 
give assessment, most calls for reformed science assessment agree on two 
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features of desirable assessment: the assessment should exemplify desired 
performance, and the assessment should report results in ways that inform 
change towards the desired goals. 

The first requirement, that assessment should exemplify desired 
performance, combines the notions of validity and science reform: the 
assessments should validly reflect what they are supposed to assess, and what 
they are supposed to assess should be "good science education" (which is often 
different from wnat currently exists, according to the reform-minded reports). 
The fear is that assessments may reliably measure certain knowledge, skills, 
or aptitudes, and yet those entities may not be desirable goals or 
competencies. The second requirement, that the assessment should report 
results in ways that inform change towards the desired goals, acknowledges 
that assessments should be intended to inform derision-making and action. As 
action- or decision-oriented reports, part of assessments' validity stems from 
their design, implementation, and use for those practical goals, not only from 
psychometric analysis or content experts' reviews (cf. Messick, 1989). 

Purpose 

Our overarching purpose is to construct science assessment models and 
examples that contribute to improved science education. Although our main 
project, sponsored by ET^, focuses on instructional assessment- -or assessment 
done by teachers and students in classroom settings to improve science 
learning and teaching- -we felt it was important to understand the assessment 
context in which teachers are working, and also the national trends in science 
education and assessment. Hence, the broad objective of this study was to 
survey current state science assessments and determine to what extent the 
assessments support standards of student performance consistent with the goals 
of science education reform. Our specific question in this study focuses on 
the relation between test specifications and the requirements of science 
reform: flow consistent are the currently used state science assessments to 
the goals of science reforms such as the landmark report of the American 
Association for the Advancement of Science's Project 2061: Science for All 
Americans ? 



General Specifications for Assessments from Science Reform 

Re-zent reforms in American science education include sponsorship of 
significant science curriculum development projects by the National Science 
Foundation at the elementary a middle school grade levels (NSF, 1989), and 
issuance of a major report. Project 2061 . by the AAAS (AAAS, 1989) seeking to 
define the knowledge, skills, and attitudes all students should acquire in 
science, mathematics and technology. The NSF- sponsored projects and tihe AAAS 
report share an emphasis on development of "scientific literacy" (where 
scientific literacy is defined as the science end technology to be learned and 
applied by citizens, as contrasted with science knowledge and skills learned 
by students intending to major in science in college). One critical criterion 
is to snow relationships between scientific principles and ways of knowing, 
technological applications, and personal and social issues. A second common 
emphasis is on depth of experience and mastery of critical knowledge, rather 
than on breadth of coverage. The AAAS succinctly stated that the goals are 



to: 

"Identify only a small core of essential knowledge and skills. Do 
not call on the schools to cover more and more material, but 
instead recommend a set of learning goals that will allow them to 
concentrate on teaching less and on doing it better. Focus on 
scientific significance. Identify only those concepts and skills 
that are of surpassing scientific importance." (AAAS, 1989, pp. 
viii-iy) . 

Three specific points of science education reform, then, against which 
the state assessments may be analyzed, are to what extent the assessments do: 

1. focus on central concepts, skills, and attitudes rather than on 
uncontextualized, fragmented, or lower-level knowledge skills; 

2. focus; on or promote development of depth of those central knowledge, 
s kills, and attitudes rather than breadth at the expense of depth; 

3. cor.iect science to technical, personal, philosophical, and social 
applications and phenomena. 

Methods and Data Source 

We were fortunate to be able to draw upon the comprehensive surveys of 
science and math assessments conducted by the Education Commission of the 
States (ECS, 1987) and the U.S. Office of Technology Assessment (OTA, 1987). 
Both the ECS and OTA reports were based on 1985 data. Much of our work 
reported here involved updating the ECS data, and examining the assessments 
from a diff»irent angle. 

All the states were contacted by phone in April 1990; most had been 
previously contacted in July 1989. In addition to verbal reports of the 
state's science assessment, other information about the states' science 
assessment instruments was gathered, including general descriptions written 
for public release, sample items, summary results, and actual assessment 
instruments, if available.^ Even in less than a year's tirie there were 
changes in individual states' science assessment plans and instruments, and 
policies. Clearly this is a d)mamic area, and the results of this survey will 
be accurate only for a limited time. 

Copies of the commercial tests used by the states in their science 
assessments were examined. Whe;re several forms exist, the form closest to 
grade level 6-7 was used. The information auout the commercial tests' 
content-process specifications was obtained from the information sections 
included with each test. Within each assessment, specific items were 
subjected to content and cognitive analysis. Commercial tests are also 
modified and revised, and it may be that the specific information about the 
commercial tests in this report will also soon need to updated. 

Although states may test across several grade levels, in this study we 
focused our analysis (but not the survey) on the middle school science grades 
6-7. Pre-high school science, we guessed, would be more likely reflect the 
science literacy goals than the more discipline-oriented high school grades. 



% tat e- cons true ted assessment materials were received from 17 states, 
including some states that did not have a mandator^' state science assessment. 
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In addition, middle school science has been identified as a key filter, or 
choice point where students decide long-lasting attitudes about science (e.g., 
Mullis & Jenkins, 1988) and about future course selection. In addition, other 
filters are established in middle school, notably academic mathematics 
preparation (e.g., Beane, 1985). Middle school is an important time for 
assessments to provide information and encouragement. 



Results 

The results of ovr survey and analysis indicate that: 

1. scate science assessments clearly are not a driving force in directing 
the curriculum or instructional practices towards the standards of 
science education reform in the United States. 

2. In fact, state science assessments vary so widely that it may be 
questioned whether they have a major effect at all on a oherent 
national science direction. 

3. In addition, almost all state assessments' content structures do not 
appear to be consistent with currant science education reform goals. 

4. The process aspects of standardized tests are weak to non-existent. 

5. However, in light of the inconsistency of almost all the state science 
assessments to the science reform goals examined in this study, it may 
be a positive thing that state assessments are not powerful determinants 
of curricultim and instruction. 

These conclusions are reported in greater detai.l below. 
Influence of State Science Assessments From a NatioTial Perspective 

The data show that the majority of states have little direct leverage on 
science educacion, either through requirement of a state-wide means for 
comparison or through accountability measures tied to science performance. Of 
the 50 states, almost 50% (24 states out of 50) do not have a science 
assessment at the state level. (See Table 1; full data shown in Appendix A.) 
Of those states that do have a state science assessment, very few have 
stronger accountability sanctioyis than reporting scores publicly. Our 
conclusion is that state science assessments, from a national perspective, are 
not a driving force in directing curriculum or instructional practices towards 
the standards of science education reform. Indeed, for almost half the states 
there is no state- level asse*?sment to "drive" science towards any standard. 

The five states that do have strong state-controlled accountability use 
mechanisms including tying performance on state assessments to funding 
sanctions, school accreditation, or student graduation. "Public 
accountability" reports are thus mixed with reporting 'results to the school or 
teacher for curriculum improvement, monitoring student progress, placement, 
and diagnosis. A mixture of report forms are generated, including reporting 
individual and group scores. The scores may be in the form of raw scores, 
criterion- referenced scores, or various transformations of norm- referenced 
scores. The scores may be sent to schools and teachers to be used in 
diagnosis, placement, and instructional planning. Group scores are reported 
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at the state, district, snd school levels, varying from state to state. Group 
scores are supposed to be used for state policy, curriculum revision, and 
development. The important point here is that none of the currently available 
reports contain information that is useful for assessing performance in 
relation to the science reform goals (e.g., centrality, depth, or 
connections), no matter the accountability, program evaluation, or 
instructional diagnosis purposes, since performance scores are aggregated 
without regard to the science reform dimensions. 

Nature of the State Science Assessment Instruments 

On the basis of our analysis of the state science assessment programs' 
instruments and specifications, we concluded that state science assessments 
have varied sources, mandates, purposes, and varied curriculum specifications, 
but they almost all have similar design specifications. Those design 
specifications include: paper and pencil, multiple-choice format; no more than 
60 items; one hour administration time; administered twice a year at most; 
requires that students work individually; sur\;^ey Life,, Physical, and 
Earth/Sea/Space sciences and several science process skills; and the reports 
compress and aggregate results into unidimensional scales and/or single 
composite scores. In other words, short, highly sampled, multiple-choice 
tests dominate.^ 

Of the 26 states that reported having science assessments, 10 use only 
commercial standardized tests, 13 use state -cons true ted tests, and three 
states use both commercial and state-constructed tests. 



Table 1. Numbers of states with each source of science assessments. 

Source of Test No. of States 

No state science assessment 24 (48%) 

Conimercial test only 10 (20%) 

State-made test only 13 (26%) 
Commercial and state tests 3 (6%) 

Total 50 



Table 2 shows the number of states using each of the commercial tests 
for assessment. 



Table 2. Number of states using each of six commercial tests for state 
science assessment, grades 4-8. 

SAT CTBS ITBS CAT MAT6 TAP TOTAL 



California, New York, and Connecticut are exceptions in that their state 
science assessments include or specify at least some performance -based or other 
significantly open assessment component. 
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No. of 
states 



16* 



*Three states use multiple commercial tests 



In the commercial standardized tests examined, the Science section 
varies in length from 25-60 questions, with an average of approximately 40 
science items. These items are spread across the traditional disciplines of 
Life Science, Physical Science, and Earth and Space Science; some tests 
further subdivide the content categories. Four of the six tests also cross- 
reference each item to a process skill. TV.c other two tests focus on Content 
Knowledge in its science sections . 

There are two different approaches to testing the Process Knowledge m 
these tests. Three of the tests use variants of the cognitive skills outlined 
in Bloom's Taxonomy of Educational Objectives (Bloom et al., 1954): knowledge 
or recan, comprehension, application and analysis, and synthesis and 
evaluation. The other organization of process skills used the AAAS scientific 
task analysis: classify, hypothesize, measure, and infer. The state 
assessments were very similar in their content-process specifications, 
especially those assessments that were multiple -choice format and administered 
annually. The commerciial standardized tests are summarized in Table 3. 

Table 3. Summary of commercial standardized tests used in state science 
assessments . 



GRADE LEVELS NO. 
TEST NO. /RANGE ITEMS 
SAT 4/3.5-9.9 44-60 



CTBS 7/1.6-12.9 25-40 



MAT6 6/1.5-12.9 31-50 



CONTENT 
FRAMEWORK 
Physical science 
Biological sci. 



Botany 

Zoology; Ecology 
Physics , Chem- 
istry, Land/Sea/ 
Space 

Physical sci . ; 
Earth and space 
Life science 



PROCESS 
FRAMEWORK 

Analysis, infer, predict, 
classify, experiment, 
measure , hypothesis 

Recall, Explicit informa- 
tion skills. Inferential 
reasoning. Evaluation 



Knowledge , 
Comprehension; 
Inquiry skills; 
Critical analysis 



TAP 4/9-12 



CAT 9/1.6-12.9 



54 



25-40 



Nature )f sci. 
Life science 
Earth/space 
Chemistry/ 
physics 



ICnowledge/information 
Compr ehens i on 
Application/analysis 
S3ni thesis/evaluation 
Fxperimental methods/ 
techniques 



Botany; Zoology; Ecology; 
Physics; Chemistry; 
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Land/Sea/Space 



40-45 Life science; Earth and space science; Physics; 

Chemistry; Health and safety; Nature of science 
(Methods of inquiry; Nature of evidence; Nature 
of proof; Cause and effect; stability and 
change) 



Stanford Achievement Test (SAT), Comprehensive Test 
(HAT6), Tests of Achievement and Proficiency (TAP), 
skills (ITBS). 



of Basic Skills (CTBS), Metropolitan Achievement Test 
California Achievement Tests (CAT), Iowa Test of Basic 



The CTBS exemplifies a "typical^* standardized test. Table 4 shows the 
Content and Process specifications for the CTBS level H (1983, grades 6.6- 
8.9). 



Table 4 Numbers of items of the Science section of .the California Test 
of Basic Skills (level H. grade level 6,6-8,9) identified (^ith each 
Content and Process area. 



Content 



No. of items 



Botany 8 

Zoology 10 

Ecology 5 

Physics 5 

Chemistry 6 
Land/Sea/Space _6_ 

Total 40 



Process No . of items 

Recall ^ 
Explicit Info, skills 21 
Inferential reasoning 5 
Evaluation 10 



The examination of assessment specifications and content analysis of 
sample items shows that both commercial tests and state-constructed 
^.ssessments fail to meet the science education reform goals exemplified by the 
AAAS 

" The content structures are inconsistent with current science education 
reform goals. There is a clear mismatch between the breadth of content 
coverage specified by the test and what most middle school science classes 
actually cover, let alone what is advocated by Project 2061 and other reform 
documents. In addition, the itemL appear to represent a sample of topics 
within each d5-cipline. Such treatment certainly is not conducive to 
encouraging learning an area in depth. Sparse sampling neither addresses what 
is or should be taught, nor provides incentives for addressing topics in 
depth. On the CTBS test shown in Table 4 for example, there are five items 
that deal with ecology. However, the California state curriculum guidelines- 
identify four major concents for ecology; middle school textbooks commonly 
divide treatment of ecology into three main chapters and over 20 major 
headings (Gong et al., 1990). Most of the assessment items examined, however, 
deal with facts, not principles, and appear designed to tap lower-level 
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thinking skills. For example, none of the CTBS items appeared directly to^ 
require knowledge of central concepts such as California curriculum guidelines 
and Project 2061 advocate. None of the tests had clusters of questions to 
probe understanding of principles in multiple contexts, applications, or 
levels of difficulty. Thus, there was no way to assess whether a student 
answered a question by reasoning from high-level principles, by memorizing a 
specific fact, or by guessing. (This larger issues of whether the assessments 
validly tap process skills is addressed in greater detail by Gong, 1990.) 

Even on paper, the Process aspects of state science assessments are weak 
to non-existent. It is interesting to note that the Process categorizations 
for the CTBS example in Table 4 did not reflect any developmental sequence 
across forms. That is, there are not more items thnt supposedly tap "higher 
order thinking skills" (e.g.. Evaluation) in the test forms for the higher 
grade levels than there are in the tests for younger students. In fact, the 
CTBS form for grades 6-8 shown in Table 4 has twice as many "Evaluate" items 
as the form for grades 11-12. In any case, almost every t°st will be of 
little use to a teacher or science educator because the reports generally 
report a highly aggregated score for "content." And even though they have 
Process specifications, none of the commercial standardized tests report skill 
or process performance. Thus, administrators, teachers, students, and parents 
do not even get a report that attempts to reflect performance on higher order 
thinki.ng . 

None of the items examined appear to tap knowledge of technology or 
current social issues. All the items examined deal with content as it might 
be presented in a science textbook, or in common personal experience (e.g., 
growing a i^lant) . On the point of dealing with science in ways and forms 
, appropriate for developing a scientifically literate citizenry, then, these 
assessments also fall short of the desired mark. 

Summary 

In summary, state science assessments have the potential for being a 
driving force in barely half of the states currently. For the states that do 
have a scate science reform, almost none appear to have a current state 
science assessment program that will help direct curriculum or instructional 
practices towards the standards of science education reform. The majority of 
state science assessments' content structures appear inconsistent with current 
science education reform goals, and the process aspects are weak to non- 
existent . 

In light of the inconsistency of almost all state science assessments to 
the science reform goals examined in this study, it may be a positive thing 
that state science assessments are currently not powerful determinants of^ 
curriculum and instruction nationally. We may wonder whether the "something" 
of science assessments in place in half the states is better than the 
"nothing" at all favored by the other half of the states. In any case, we may 
be glad that the weakness of most state science assessments provides 
opportunities to reform the assessments as well. 
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When Is "Something" Better Th an "Nothing"? 

The low number of states with state assessments in science is surprising 
and disturbing. It reflects the low value placed on science education. Not 
counting the seven ^tates that have no state assessments of any kind, it shows 
that 60% (26 of 43) ofAche states that have state assessments—usually in math 
and reading have put science assessment on a back burner. Thus, having a 
state assessment in sdience may be a good sign, one tha:: says the state 
legislature or other have agreed thctt science is important. In such a 
climate, whether or not the assessments are valid, they may have good side- 
effects. As one district science curriculum assistant noted, "I would welcome 
a state test in science, because it would buy science time in the crowded day. 
As it is now, we are constantly pushed aside in favor of math and language 
arts --subjects that are being tested." In the upper elementary grj^^es, 
science is often allocated only 20 minutes a day for instruction; some 
districts require as little as 12 minutes a day, or one hour a week. Buying 
time is a large issue. Thus, assessments may be poor evaluation instruments, 
but still play beneficial roles in the educational system. 

Of course, it wo-^d be better if assessment programs' direct effects 
wero also beneficial. Carefully conceived and implemented state-mandated 
assessments can pl&y a significant role in promoting good science education 
(Armstrong et aJ.., 1988). To construct such assessments we must have more 
detailed models that go beyond empirical and conceptual links between 
performance and objectives as contained in state and local assessment; we must 
identify how much, why, and how tests are related to curriculum, instruction, 
and cognition. 1 '.e links between assessment and science education have not 
' yet been established in detail. In particular, testings' influence on 
learning is not well-understood, although the research literature (and common 
knowledge claims) are full of impassioned yet often contradictory claims, such 
as cests drive the curriculum, tests reflect the textbooks; the format of 
tests channelize students' attention and lead to piecemeal learning, tests 
promote coaching; tests contribute to bias, tests help eliminate local 
disparities. T sort out the complicated picture of the connections between 
assessment and i earning, teaching, and curriculum will require additional 
studies that address the political, social, and psychological decisions and 
organizations related to what happens in classrooms, students' heads, state 
education offices, and textbooks' publishing houses. Even more important than 
documenting what assessments currently are, we must construct models-- 
conceptual and actual prototypes- -for making assessments positive forces in 
educational reform. The models should be research-based, decision/action- 
oriented, have strong ties to curriculum and instruction, and be more 
responsive to teacher/student needs. 

Good assessments should be based on well-articulated educational goals. 
This requires that the ecological relations of assessment and other partj of 
the educational system should be clearly articulated and coordinated. The 
assessment, curriculum guidelines, teacher education, local staff development, 
and funding infrastructures should be consistent and integrated. An 
evolutionary plan, championeo a committed "evangelist" with a power base, 
may be most appropriate for most states: .periodic, systematic improvement of a 
science assessment program can go beyond the current assessments in a series 
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of steps. (See reports of California's or Connecticut's experiences, e.g., 
Shavelson et al., 1990; Baron, 1900.) 



Research and Development Work 

Tests must be "tuned," or constructed for particular purposes. Those 
who mandate, design, and use tests should be clear on the purpose of the test: 
is it to hold student performances accountable, for program evaluation, 
program improvement, student diagnosis, or something else such as enforcing 
usage of a syllabus. 

We need additional information about how test information is used so we 
can design tests and administration procedures that provide the necessary 
information. For example, three distinct uses that have distinct information 
design requirements are: comparison of individuals or groups to others for the 
purpose of assessing outcome or performance; longitudinal comparisons for 
assessing progress or change within a group or individual; and assessment of 
performance to inform instruction or curriculum design. Another way of 
addressing th3-s concern is to note that the criteria and sources of criteria 
for interpreting the assessment must be clear: are they norm- referenced (e.g., 
ranking, percentile), criterion-referenced, self -referenced (e.g., progress 
over time), contextualized (e.g., compared against other districts or students 
with similar backgrounds); and the standards vary from being minimal 
competency to a core requirement to a moderately high target for all. 

The majority of current science assessments must be examined and revised 
before using them to show standards of desired student performance. The 
reporting structures especially are weak. They are over-simplified for 
policy-makers, and do not have the right information for those at local levels 
'who need to make decisions about curriculum and instruction. Too often the 
state assessments treat education like a game of "Blind Man's Bluff," with 
score reports calling out "Warmer!" or "Colder!" once a year--hardly the best 
information for informing the educational decisions that teachers and 
superintendents have to make sometimes daily. 

It is hoped that studies such as this one will help inform policy 
makers, test developers, educators, and parents so they can guide the 
development of more appropriate assessments that will suppiort a population 
that is truly more scientifically literate. 
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STATES USING COMMERCIAL STANDARDIZED TESTS 
FOR STATE SCIENCE ASSESSMENTS 





Test Name 


Admin. 


^^^**0 ^ f 

UiTaOBS 


Alabama 


SAT 


Annual 


(4.8.) 


Arizona** 


ITBS 
SAT 


Annual 
Annual 


(1-8) 

/ n TON 

(9-12) 


Arkansas 


MAT6 




// ^ 1 Q TAN 

(4,6,7,8,10) 


Georgia** 


ITBS 




(2,4,7,9) 


Idaho 


ITBS 
TAP 


A' aal 


(6,8,11) 


Louisiana* 


CAT 






New Hampshire 


CAT 


Annual 


(4,8,10) 


New Mexico 


CTBS 


Annual 


QJ,D,0,iU; 


S. Carolina* 


CTBS 


Annual 


(4,5,7,9,11) 


S. Dakota 


SAT 


Annual 


(4,8,11) 


Tennessee 


SAT 
CTBS4 


Annual 


(2,5,7,9,11) 


Virginia* 


ITBS 


Annual 


(4,8,11) 


West Virginia 


CTBS 


Annual 


(3,6,9,11) 



13 TOTAL 



* 3 states also use state-constructed tests. 
** State-constructed test planned. 
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STATES UbING STATE- CONSTRUCTED TESTS 
FOR STATE SCIENCE ASSESSMENTS 



California 

Colorado 

Florida 

Indiana 

Louisiana* 

Maine 

Massachusetts 
Michigan** 

Minnesota** 

Missouri 
North Carolina 
Oklahoma 
New York 

Pennsylvania 

S. Carolina* 
Virginia* 



Test: Name 
CAP 

no name 

no name 

1 step no name 88/89 

I.EAP Annual 

MEA (matrix items Annual 
in science) 

MEAP 88/90 

HEAP 

MEAP 

MMAT 
NCAT 
no name 

Science Evaluation 
Manipulative Skills; 
Objective section 

EQA 
TELLS 



Admin. Grades 
Annual (8, in '90 6,12) 

1987 (trial only) (3,6,9,11) 
88/89 (crial only) (3,4,5) 



1986&88 
1989 

1992 New Draft 



(3,6,8,9,11) 
(11) 

(4,8,11) 

(4,8,12) 

(4,8,10) 
(5,8,11) 



1987 (voluntary) (4,8,11) 
1993 (mandatory) (6,9,11) 



Basic Skills 
SEPAM 



4 yr cycle 
Annual 
Annual 
1989 

Annual 
1988-89 



(3,6,8,10) 
(K-3,4-6,7-8) 
(3,7,10) 
(K-4) 

(4,6,7,9,11) 
(3,6,8) 



16 TOTAL 



Delaware and Minnesota also have Item Banks available which include Science. 
* 3 states also use conmercial tests. 
** Hew Science Assessment in Development 
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NO STATE ASSESSMENT IN SCIENCE 



Connecticut 

Delaware 

Hawaii 

Illinois 

Kansas 

Kentucky 

Maryland 

Mississippi 

Nevada 

New Jersey 

Oregon 

Rhode Island 

Texas 

Utah 

Washington 

Wisconsin 

Wyoming 



planned for 1993 (state-constructed, performance assessment) 
(has item Bank in science available) 

planned for 1992 (state-constructed, grades 3,6,8,11) 
planned for early 1990 's (state-constructed) 



planned for 1993 (state -cons true ted, to be given every 5 
years for program evaluation) 

planned for 1994-95 



17 TOTAL 



Alaska 

Iowa 

Montana 

Nebraska 

North Dakota 

Ohio 

Vermont 



NO STATE ASSESSMENT 



7 TOTAL 
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state 


Level of Assm't 
Central iz. Publ. 




Whsn 
Adrfiin* 


Grade 


Source of Individ. Scores 
opscs Keporcea ror 


Groi^ 

Reported 

To 


Scores 
For 


ALABAMA 


1 


2 

SAT 




A 


8 


compar* 

Yes between 


S.D.B. 


Indicator of National 
Standing 






1 

BCT 






3,6,9 


NOT SCIENCE TESTS 






ALASKA 


0 


N 0 


S T 


ATE 


A S S E 


S S H E N T 






ARIZONA 


2 


2 

ITBS 
SAT 




A 


1-8 
9-12 


School diagnosis 


B.D. 


In development: Arizona 
Student AssessDent Plan 
diagnosis will include science 


ARICAHSAS 




HAT6 






8, 10 


Teacher diagnosis 


D.S 


4. 5 


CALIFORNIA 


1 


1 




A 

r\ 


8 

f\T\ ton A 


12) 


e 

S 


4 

policy 


COLORADO 




? 




1937 


3, 6, 9, 
11 


B Achlev. 


D.S. 


5 


CO«HECTICUT 


NOT 


I N 


S C 


I E N C E 


In development: Cr/rmon Core of Learning Assessment used 


in HS will contain Sciei^e component. 


DELAWARE 


NOT 
1 


I N 
DEAR 


S C 


I E N C 


E 

11 


diagnosis „ 
B placement 


D.S. 


p^licy 
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state 


Level of Acsm't 
Central fz. Publ. 




When 
Admin. 


Grade 
Levels 


Source of 
Specs 


Individ. 
Reported 


Scores 
For 


Group 

Reported 

To 


Scores 
For 


FLORIDA 


1 


1 no name 


1989 


3,4,5 


(pilot) 










GEORGIA 




ITBS 






^, 4, 7, 

9 


Teacher 
committee 


Teacher 


Program 
Decisions 


O.S. 


Use is determined by the 
5 local level. Changing to 
state test in early 1990*s 


HAWAII 


N 0 


S C I E N 


C 


E T 


EST 












IDAHO 


1 


2 

ITBS 
TAP 




A 


6, 8, 11 


1 


B 


curr & instr. 
improvement 


D.S. 


curr & Instr. 
improvement 


ILLINOIS 


N 0 


S C I E N 


C 


E T 


11 

EST 


(PLANNED FOR 1992) 




No 






INDIANA 


1 


1 

ISTEP 




1989 


3, 6, 8, 
11 


2 


1 


remed. 


D 
S 


4 

4 or 5 


IOWA 


N 0 


STATE 




A S S E 


S S H E 


N T 










KANSAS 


1 


1 




A 


2, 4, 6, 
8, 10 


NOT IN 


S C I E N 


C E 






KENTUCKY 


1 


1 




1987 


K-12 


NOT IN 


S C I E N 


C E 






LOUISIANA 


1 


1 

LEAP 
2 

CAT 




A 


11 


2 




Graduation 
requi rement 


S. 


policy 
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Group 

Level of Assm't Wnen Grade Source of Individ. Scores Reported 

State Central iz. Publ. Admin. Levels Specs Reported For To 



MAINE 1 


1 

MEA 


A 


Hf Of n 1 NO 




S.D.B 


3. Results published 
8. Curriculum planning 


MARYLAHD 1 


1 


N 0 


SCIENCE TEST 




(State test being developed) 


HASSACUSETTSi 


1 


88/90 


4, 8, 12 1 No 




S.D.B. 


curr. improve., policy 


MICHIGAN 1 


1 

MEAP 


1986,88 
1989 


(4,8,10) 

(5,8,11) 1 Yes 


diagnosis 
remed. 


S.D.B. 


In development: A new draft 
of MEAP to be used in 'yd 

parent reporting, 

curr. impr., policy (4.5?) 


MINNESOTA 1 


1 

MEAP 


1007 

1987 


4, 8, 11 1 Ho 




S 
D 

B 


Building a new mandatory science 
assessment. • 
curr. improvement 


MISSISSIPPI 




N 0 


SCIENCE TEST 








MISSOURI 1 


HHAT 
1 


4-year 
cycle 


3, 6, 8, 

10 2 Yes 




S.D.B. 


materials 
policy, inst. improv. rec*d. 


MONTANA 2 


N 0 


STATE 


ASSESSMENT 








NEBRASKA 2 


N 0 


STATE 


ASSESSMENT 








NEVADA 1 


1 


NOT 


IN SCIENCE 








N HAMPSHIRE 2 w/1 


CAT 
2 


A 


4, 8, 10 3 w/1 Yes 


S 

7 


D, B 


policy, comparisons 
instruc. improvement 
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Group 

Level of Assm't When Grade Source of Individ. Scores Reported Scores 

State Central iz. Publ. Admin. Levels Specs Reported For To For 



NEW JERSEY NOT IN SCIENCE 



NEW MEXICO 1 


CTBS 


A 


3, 5, 8,10 




Yes 


Student 

Progress 

diagnosis 


B.D.S. 


monitor prog., accred., policy 


NEW YORK 1 


1 

sci. eval. 
manip. 
skills; 
p & p test 


A 

89 


9-12 
K-4 


2 


No 




B.S.D. 


policy, school improvement 


K-3 
4-6 

NORTH CAROLINA 1 7,8 
NC Science Achievement Test 


A " 


3, 6, 8 


2 


Yes 


Report to 
instruct, 
planning 


Teaching prescribed 
S.D.B. curriculum 


NORTH DAKOTA 


N 0 SCIENCE ASSESSMENT 
2? A 


All but 
grade 3 


? 


Yes 


? 


B.D.S. policy 


OHIO N 0 


STATE 


ASS 


E S S M E N T 












OKLAHOMA 




A 


3, 7, 10 


2 


Yes 


diagnosis 


S.D.B. 


4, 5 policy 


OREGON NOT 


I H S 


C I E 


N C E 


(may be cut 


altogether ^ 


In development: Science Assessment for use every 5 years for 
program evaluation. Target date: spring *93. 


1 

♦PENNSYLVANIA 


EQA *voluntary 
1 

1 1 
TELLS *mandatory 


A 


4, 6, 7, 
9. 11 


1 and 2 


Yes 


? 


8. program planning 
S.D. program evaluation 
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Level of Assm*t 
State Centralize PubU 



When Gr.jde 
Admin* Levels 



Source of 
Specs 



Group 

Individ. Scores Reported Scores 

Reported For To For 



RHODE ISLAND 



NOT IN SCIENCE 



S. CAROLINA 




1 


CTBS (89) 
SAT (9D) 
1 and 2 A 

Basic (3,6,8) 4,5,7, 

skills 9,11 2 


Yes Program dev* 


B.D.S. 4,5 




S. DAKOTA 


1 


SAT 
2 


A 4, 8, 11 Yes 


eval*? B.D.S. 


policy, curr, eval. 




TENNESSEE 


1 


2 

SAT 
CTBS4 


A 2, Sj 7, 1 and 2 Yes 
9, 12; 
2-8,lD 


diagnosis S.D.B. 


policy 




TEXAS 


1 


1 


A NOT IN SCIENCE 


(Planned for 1994-95 for 
grades 3,5,7,9,11) 






UTAH 


NOT 


I N S 


C I E N C E 








VERMONT 


N 0 


STATE 


ASSESSMENT 








VIRGINIA 


1 


2 " 
ITBS 
SEPAM? 


Annual 4, 8, 11 2 Yes 


diagnosis B*D* 
prog« evaU 


3. public report 




WASHINGTON 


1 


HAT 
2 


SCIENCE ASSESSMI^NT SECTION OF HAT OPTIONAL 








W. VIRGINIA 1 


2 


A 3, 6, 9, 11 1/2 Yes 


diagnosis B*D. 


policy, curr. cvol. 





CTBS 
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state 


Level of 
Central iz. 


Assm't 
Publ. 


When 
Admin. 


Grade 
Levels 


Source of 
Specs 


Individ. 
Reported 


Scores 
For 


Group 

Report" 

To 


Scores 
For 


WISCONSIN 


1 


CTBS 
2 


NOT 


I N 


SCIENCE 










WYOMING 


1 


NAEP 
2 


NOT 


I N 


SCIENCE 











CODE KEY 

Level of Centralization 

0 = no state requirejnents 

1 s state test 

2 = local tests 



Assessment Publisher 

1 s state 

2 ^ commercial (name) 



When Administered 
A = annually 



Source of Assessment Specs. 

1 = state assess, conmittee 

2 = State curr* guidelines 

3 = local 

4 = want but don't have 



Use of Assessment Results 

1 = report to state 

2 = report to local 

3 = public report 

4 = state sanctiv-jn, reward 

5 = local sanction, reward 

6 = graduation requirement 

7 = diagnosis, placeinent 

8 = program/curriculum improvement 

9 = policy 



Results Reported to 

S = state 

0 = district 

B = school building 



SUMMARY OF STANDAitDIZED TESTS 
OF SCIENCE ACHIEVEMEHT 
USED IN STATE ASSESSMENTS 

NB: Several tests have more recent editions than those cited here, but the 
modifications to the content/process categorization specifications appear 
relatively minor. In many of the tests, the science section is an addendum to 
a core battery. 

1982-83 Comprehensive Test of Basic Skills (CTBS) 

* 25-40 questions 

* Seven levels - Grades 1.6 to 12.9 

* Content / Process 



Content 

Botany 

Zoology 

Ecology 

Physics 

Chemistry 

Land/Sea/Space 



Process 
Recall 

Explicit Info Skills 
Inferential Reasoning 
Evaluation 



1986 Iowa Test of Basic Skills (ITBS) 

* 35-45 questions 

* Five levels - Grades 3-9; Grades K-3 levels do not offer science 
t * Content / Process 

Life Science 

Earth & Space Science 

Physics 

Chemistry 

Health & Safety 

Nature of Science 

Methods of Inquiry 

Nature of Evidence 

Nature of Proof 

Cause and Effect 

Stability and Change 

1986 Metropolitan Achievement Test (MAT6) 

* 31-50 questions 

* Six levels - Grades 1.5 to 12.9 

* Content / Process 

Content Process 
Physical Science Knowledge 
Earth and Space Science Comprehension 
Life Science Inquiry Skills 

Critical Analysis 
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1987 Tests of Achievement & Proficiency (TAP) 

* 54 questions 

* Four levels - Grades 9-12 

* Content / Process 



Content 

Nature of Science 
Life Science 
Earth/Space 
Chemistry /Physics 



Process 

Knowledge/Info 

Compr ehens ion 

App lie at ion/Analys is 

"Synthesis/Evaluation 

Experimental methods/ 

Techniques 



1986 California Achievement Tests (CAT) 

* 25-40 questions 

* Nine levels - Grades 1.6 to 12*9 

* Content 

Botany 

Zoology 

Ecology 

Physics 

Chemistry 

Land/Sea/Space 



STANFORD ACHIEVEMENT TEST 



1982 Stanford Achievement Test (SAT) 

* 44-60 questions 

* Four levels - Grades 3.5 to 9.9 

* Content / Process 

Physical Science 
Biological Science 
Inquiry Skills (Process) 
Analysis Infer » 
Predict Classify 
Experiment Measure 
Hypothesis 



LEVEL 

Primary 3 
Intermediate 1 
Intermediate 2 
Advanced 



GRADE 

3.5-4.9 
4.5-5.9 
5.5-7.9 
7.0-9.9 
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18 Biological Science 
7 Living objects 
11 Environmental Interactions 

15 Inquiry Skills 
3 Infer 
3 Measure 
6 Analyze 
2 Hypothesis 
1 Classify 
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